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ABSTRACT 

We study difference inequality systems for the 3x + 1 problem introduced by the first author in 
1989. These systems can be used to derive lower bounds for the number of integers below x for 
which the 3x + 1 conjecture is true. Previous methods obtaining such lower bounds gave away 
some information in these inequalities; we give an improvement which (apparently) extracts 
full information from the inequalities in obtaining a lower bound. 

We deduce, by computer-aided proof, that for any fixed positive integer a not divisible by 
3, and for large enough x (depending on a), at least x ' 84 of integers below x have a in their 
forward orbit under the 3x + 1 function. 

Mathematics Subject Classification (2000): 11B83 Primary; 26A18, 32H50 Secondary 

Keywords: 3x + 1 problem, difference equations, dynamical system, iteration, nonlinear pro- 
gramming 



1. Introduction 

The 3x + 1 problem concerns the iteration of the 3x + 1 function T{n) = n/2 if n is an even 
integer, (3n + l)/2 if n is an odd integer. The well known 3x + 1 Conjecture asserts that all 
integers n > 1 eventually reach 1 under iteration of the 3x + 1 function. Known results on this 
problem are surveyed in Lagarias || and Wirsching 0. 

Let vti(x) count the number of integers below x that eventually reach 1 under this iteration. 
There are several methods known for establishing lower bounds of the form tti(x) > x@ for a 
positive constant j3. see [|J], [|[. The first such bound was obtained in 1978 by Crandall J3[. 
The strongest of these methods at present is one introduced by the first author in 1989 ([§]]), 
which uses systems of difference inequalities, and here we consider it further. 



This method formulates, for each k > 2, a system 1^ of functional difference inequalities 
(mod 3 fc ), containing about 3 fc variables, which certain functions, computed from 3x + 1 iter- 
ates, satisfy; they are specified in §2. One can establish an exponential lower bound for the 
growth rate of positive monotone solutions to these inequalities, and this translates into lower 
bounds for n\{x) of the form x^ for some positive (5. The paper [|[] used the system k = 2 
to obtain a lower bound x ' 43 for the number of such integers. Later Wirsching || used the 
system k = 3 to obtain the lower bound x 0,48 , for all sufficiently large x. 

In 1995 Applegate and Lagarias [Q] gave an approach using nonlinear programming to 
systematically extract lower bounds from the difference inequalities Ifc. The first step was 
to iterate the inequalities to obtain a derived system of difference inequalities T> such that 
any positive, monotone solution to the original inequalities would remain a solution of the 
derived inequalities. This step can be done in many ways, in an ad hoc fashion. Given such 
a system of difference inequalities T> they associated a family of auxiliary linear programs 
LjP(A) depending on a parameter A. The parameter A lies in the interval 1 < A < 2, and the 
coefficients of the linear program depend nonlinearly on A. If the system T> contained only 
"retarded" variables (as defined below) then any positive feasible solution to the linear program 
for a fixed A yields rigorous exponential lower bounds for the growth of any positive montone 
solution of the system T>, with exponential growth constant A; the associated exponent in lower 
bounding 7ri(x) is then 7 = log 2 A. One searches for the largest value of A for which a positive 
feasible solution exists, which is a nonlinear programming problem. To obtain an inequality 
system with retarded variables only, Applegate and Lagarias |2| found it necessary to apply a 
"truncation" operation which weakens the inequalities and presumably weakens the exponential 
lower bounds attained. Using the system k = 9, and a particular sequence of reductions to 
derive a suitable system T>, a large computation yielded a lower bound tti(x) > x - 81 for all 
sufficiently large x. Up to now this is the best asymptotic lower bound for tt\(x). 

The nonlinear programming approach in [Q] does not apply directly to the original differ- 
ence inequalities because they contain terms with "advanced" variables (as defined below). 
The purpose of this paper is to establish that the lower bounds derived from the auxiliary 
linear program family associated to the original inequality system X^, denoted L^ T (X), do give 
legitimate lower bounds for the 3x + 1 function, even though this system contains advanced 
variables. The main theorem is stated in §2. 

This result yields an immediate improvement of the exponent for lower bounds for the 3x + l 
problem for the system k = 9, relying on computations reported in Q. The computations given 
there for the linear program denoted L^ T for k = 9 (which has equivalent growth expoonent 
to the linear program Lg T (X) studied here) yield a better exponent than any of lower bounds 
rigorously established in [Sj. Using a further computation for k = 11, we obtain the improved 
lower bound 

7Tl(x) > X°- 84 , 

valid for all sufficiently large x, given in §6. 

The main interest in the improved result, however, is that the linear program families 
L^ T (X), although of exponential size in k, have a relatively simple structure. One hopes that 
a bound of the form 7Tx(x) > for any e > can eventually be proved by considering 

L^ T (X) for arbitrarily large A, and understanding better the structure of the feasible solution 
sets to these linear program systems. 
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2. Main Result 

We first recall the difference inequalities of Krasikov Q. We consider the 3x + 1 function 
T(n), and for a ^ (mod 3) and x > 1 we define the function 

ir a (x) ■= #{n : 1 < n < x,some 

and the related function 

7r*(x) := ff{n : n < x, some T^\n) = a, all T^'(n) < x for < z < j}. 

Note that 7T*(x) < 7T a (x). For each residue class to (mod 3 fc ) with m/0 (mod 3), we define 
for y > the function 

0™(y) := inf{7r*(2^a) : a = m (mod 3 J ) and a not in a cycle}. 

This function is well defined because there always exists some a = m (mod 3 fc ) not in a cycle. 

This definition immediately implies that for k > 2 and all m (mod 3 fc ), to ^ (mod 3), 
these functions satisfy the three properties: 

(PI) (Positivity) For all y > 0, 

C(y) > i- 

(P2) (Monotonicity) For y > 0, 

4>™(y) is a nondecreasing function of y. 
(P3) (Minimization) For m € [3 fc_1 ] and all y > 0, 

C-i(y) = mmtC^.C^" 1 ^).^ 2,3 ^^)]- 
It is easy to see that 

= 4 m (v - 1) if m = 1 (mod 3), (2.1) 

hence it suffices to study (/>™(y) f° r V — 2 (mod 3). For convenience in what follows we let [3 k ] 
denote the set of congruence classes 

[3 fc ] := {m (mod 3 k ) : m = 2 (mod 3)}. (2.2) 

The difference inequality system of Krasikov Q can be put in the following form. 

Proposition 2.1. Let a := log 2 3 ~ 1.585. For each k > 2, the set of functions {<p^(y) '■ m € 
[3 k ]} satisfy the following system Ik of difference inequalities, valid for all y > 2. 
(Dl)Ifm = 2 (mod 9) then 

> 4 m (y - 2) + #T 2)/3 (y + « - 2). (2.3) 

// m = 5 (mod 9) i/ien 

C(y)>^ m (y-2). (2.4) 

//to = 8 (mod 9) i/ien 

> 4 m (y - 2) + 4 2 T 1)/3 (y + « - 1) (2-5) 

In these inequalities the functions 4>k-i(y) are defined by 

C-i(y) := min[C(2/),C +3fe " 1 (y)>C +2 " 3 ' i " 1 (2/)]- ( 2 -6) 
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Proof. This follows from ||, Lemma 4], and appears in g Prop. 2.1]. ■ 

We regard the system of inequalities as expressed entirely in terms of the functions 
{4>k{y) '■ tn £ [3 fc ]}, by using the minimum formulas d2.6|) . In that case all functions appearing 
are of the form (f>™(y + for various real numbers (5j. If (5j > we call such a term advanced, 
while if (3 < we call such a term retarded, since the terms have advanced arguments and 
retarded arguments respectively, in terms of the "time" variable y. 

Applegate and Lagarias Q associated to 2k various auxiliary linear programs L^(\) de- 
pending on a parameter A > 1; strictly positive feasible solutions for admissible linear programs 
for a given A lead to exponential lower bounds for the functions (j>™(y) > cq\ v . Here we study a 
particular linear program family, denoted L^ T in Q, associated directly to the inequalities Ik, 
to which their methods did not apply to get any lower bound. Actually we consider a modified 
linear program family L^ T (X) given below; this differs from L^ T in having a different objective 
function variable, being a minimization rather than a maximization, and having the certain 
nonnegativity constraints modified to make them strictly positive. However, as shown in §6, 
this modified linear program is equivalent to the one in [Q] in the sense that matters here: it 
has a feasible solution for A if and only if the corresponding linear program in j2j has a strictly 
positive feasible solution for the same A. 

The linear program family L k T {\) is as follows. 



L^ T (A) : Minimize C^ ax (2.7) 



subject to: 

(LO) For all m E [3 fc ] 



i < < c]? ax 



(LI) For all m £ [3 fc ] with m = 2 (mod 9), 

4m-2 

cT < 4 m \- 2 + c k :\ A- 2 . (2.9) 
(L2) For all m G [3 k ] with m = 5 (mod 9), 

< 4 m \- 2 . (2.10) 

(L3) For all m G [3 k ] with m = 8 (mod 9), 

2m-l 

cf<4 m X- 2 + c k _\ A"- 1 . (2.11) 



(L4) For all me [3 fc ], 

#-1 < c£\ (2.12) 
cJT-i < c- +3fe , (2-13) 

Note that the inequality signs in (L1)-(L3) go in the opposite direction from that in the 
difference inequalities X\~, while (L4) goes in the same direction. 
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We call the variables {cj™ : m € [3 fc ]} principal variables in L^ T (X), and the variables 
{cJIL j : m ^ P^" 1 ]} auxiliary variables; the remaining variable C™ ax is the objective function 
variable. The objective function variable itself plays no role in determining feasibility of the 
linear program; the inequalities it appears in can always be satisfied by setting it equal to the 
maximum of the principal variables. If this linear program has any feasible solution, then this 
solution may be rescaled by a multiplicative constant so that min{c™} = 1, while decreasing 
C max , hence any optimum value of this linear program will have min {c™} = 1. Given a feasible 
solution, set 

cT_r := min{c£\ c^ k ~\ c^ 2 ^ 1 }. (2.15) 

The inequalities (D4) say that c 7 J}_ l < c2Li . There are no lower bounds imposed on the auxiliary 
variables c™_ 1 , but given any feasible solution, there exists a positive feasible solution with the 
same principal variables and with auxiliary variables 

c fc-l — c k-l - l - 

Indeed (D4) still holds for this choice of auxiliary variables and the remaining inequalities 
(D1)-(D3) stay the same or weaken. 

The linear program L^ T (X) encodes advanced variables, and the theorems in J|] do not 
apply to it. Conjecture 4.1 of Q{ asserts that the largest value of A for which L^ T (X) has a 
positive feasible solution should give the largest possible exponential lower bound for positive, 
monotone functions <]?/% satisfying Our main result is that L% T (X) gives legitimate lower 
bounds for positive solutions for such functions c()™(y). 

Theorem 2.2. Let 1 < A < 2 be such that the linear program L^ T (X) has a feasible solution 
with principal variables {c™ : m € [3 fc ]}. Then for and all m 6 [3 fc ] and all y > 0, 



WM>A 1 -<%\y, (2.i6) 



in which 



Ai := - r z — ttt ■ (2.17) 

4max{c™ : m € [3 fc ]} V ; 

We believe, although we have no proof, that this result gives the largest exponential-type 
lower bound that can be extracted from the difference inequalities X^. This is discussed at the 
end of 56. 



Theorem 2.2 is established as follows. In §3 we show that there exists a sequence of back 
substitutions of the difference inequalities into themselves that results in a difference inequality 
system from which all advanced variables have been eliminated. This results in a new system of 
difference inequalities Ik(EL). We show that all solutions 0™ of which possess the positivity 
and monotonicity properties (PI) and (P2) will also be solutions of Ik(EL). 

In §4 we consider linear programs. To each difference inequality system T> (of a specified 
kind) we associate in a strictly deterministic way an auxiliary linear program family LP(X). 
Let Lu L (X) denote the linear program family attached to Ik(EL). The main result of §4 is 
the deduction that if the linear program L^ T (X) has a positive feasible solution with principal 
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variables {c™ : m € [3 fc ]}, then the linear program if L (A) with the same value of A also has a 
positive feasible solution with the same principal variable values. 

In §5 we show that any difference inequality system T> in which only retarded variables 
appear has the property that positive feasible solutions to the auxiliary linear program LP{\) 
for fixed A yields lower bounds of the form ( |2,16| ); the proof is similar to [^, Theorem 2.1]. It 
immediately follows that we get such lower bounds from the linear program family L^ L (X). 
We then prove Theorem by combining this result with the main result of §4. 

In §6 we present taxonomic data on the derived systems L^ L (X) for 2 < k < 5 and infor- 
mation on positive feasible solutions the system L^ T (\) for 2 < k < 11, computed by David 
Applegate, which yield the lower bound n a {x) > x 0,84 for all sufficiently large x. The results 
of §4 imply that the linear program family L^ L (X) might conceivably give better exponential 
lower bounds than are obtainable from the linear program family L^ T (X). Numerical experi- 
ments show this is not the case for 2 < k < 5; here k = 5 was the limit of computability for 
the system Lf L (A). 

3. Eliminating Advanced Variables 

We describe a recursive back-substitution procedure to eliminate "advanced" terms of the 
inequality system We view the inequality system 1^ as expressed entirely in terms of func- 
tions 4>™{y + (3) by replacing each term involving any variable 4>™_ x {%) + /?') by the minimization 
expression on the right side of ( |2.6D in terms of 4>™ functions. 

We start with a single inequality (D3) of the system Ik associated to a fixed m G [3 fc ], 
m = 8 (mod 9), and perform a recursive back-substitution process of the inequalities I& into 
its right-hand side. At the /th-stage of this process we will have an inequality IP (I) whose 
left side is (ft™(y) and whose right side is a nested series of minimizations of various functions 

(v + P')- The step from IP(Z) to IP(2 + 1) has two substeps. First, one picks an advanced 
term $7} (y + (3'), (3' > appearing in the right side of I™ (I) and replaces it with the right side 
of the inequality Kk for <\>™ (y') with y' = y + (3' . (This is called "splitting" a term in [||.) A 
new minimization term may appear in this process, which contains three terms 

+ n €' +3k '\y + n c' +3fe_1 (y + n ■ 

The second substep in obtaining 1^(1 + 1) is to apply a deletion rule described below, which, 
if fj" > 0, may remove up to two of these terms. The resulting inequality after the deletion 
substep is 1^(1 + 1). 

At each stage in this process the inequality I™ (I) has (ft™(y) on its left side and a sum 
of nested minimization terms on its right side, involving various functions </>™(y + (3j); it will 
have each (3j > —2, because we will only substitute for terms </>™(y + (3j) with (3j > 0, and the 
formulas (D1)-(D3) produce new terms 4>™ (y + /?'•) which have /?'• > j3j — 2. The structure of 
the right side of an inequality I™ (I) is described by a directed rooted labelled tree T k m (l), in 
which the root mode is labelled with the left side cf>™(y) of the original inequality, each node 
is either a p-node (for "principal" ) or an m-node (for "minimization" ) . The initial tree for the 
inequality IP for an m G [3 fc ] with m = 8 (mod 9) is pictured in Figure 1. 

Here p-nodes are indicated by solid points and m-nodes by circled points. Each p-node is 
labelled by data (m',/3') specifying the function (j)™ (y + f3'), while each m-node is labelled by 
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(4m, -2) 



(2HLzi )a _i) (2<2L=i +3 fc-i jQ ,_ !) (2^ +2 .3 fc - 1 ,a-l) 

Figure 1: Rooted tree for inequality (D3). 

data (m', /3') of the p-node of which it is a child. The root node is a p-node and has label 
(m, 0). The inequality 1^(0 is uniquely specified by the tree T™(1) and vice- versa; the root 
node specifies the left side (f>™(y) of the inequality I™ (I), leaf nodes specify functions appearing 
in the right side, and the internal tree structure specifies the nested sequence of additions and 
minimizations comprising this right side of the inequality. 

A step from T™(1) to T™(1 + 1) consists of picking a leaf node with label <f>™ (y + /?') which 
has j3' > and changing the tree in the following two substeps. First we attach to thie leaf 
node (as root node) the directed tree associated to the formula (D1)-(D3) of <f>™ (y') with 
y ' = y + f3'. We term this "splitting" the leaf node, following @. The tree T fc m (Z + 1) that 
results has a new p-node labelled ^ m (y + ft' — 2), and may or may not have a new m-node 
with three new leaves ( p.l| ) depending from it. If there is no m-node this tree will be T™{1 + 1). 
Second, if there is a new m node, we apply the deletion rule given below to T™(1 + 1) to remove 
some (possibly empty) subset of the three leaves in a m-term. 

Deletion Rule. For each such leaf <f)™ (y + [3"), if P" > 0, consider the directed path from the 
root node 4>™(y) to this leaf. At each internal p-vertex on this path, one has an associated value 
ffik (y + The leaf node (y + (3") is deleted if there is an internal node with m! = m" 
(mod 3 fc ) and with [3 < (3" . 

After the deletion rule is applied to 7~™(l + 1), the tree that results is T™{1 + 1), and the 
inequality correspoding to it is I™(1 + 1). We will show that the deletion rule cannot remove 
all three leaves, hence all leaf nodes on the new tree T™{1 + 1) are p-nodes, so the process can 
continue. 

The back-substitution process is not completely specified, in that one has the freedom to 
choose to split any leaf node carrying an advanced term. In practice it is convenient to require 
that all nodes at a given depth that have advanced terms be split before proceeding to split 
nodes at greater depth, but the order of splitting does not matter as the following result asserts. 

Theorem 3.1. Let k > 2, and take m € [3 k ] with m = 8 (mod 9). The back-substitution 
process applied to </>™(y) halts after a finite number of steps at an inequality I™ (I) having 
no advanced terms on its right side. The number of steps I and the final inequality I-PQ) 
are independent of the order in which advanced terms are split; let I™ (EL) denote this final 
inequality. 
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Proof. We first show that the back-substitution procedure always halts. We suppose not, 
and obtain a contradiction. Let % = 7^ m (Z) denote the rooted labelled tree associated to the 
inequality I™ (I) for / = 1,2, ... . Then we have an infinite sequence of trees, each containing 
the last as a subtree having the same root, and the process defines an infinite limiting tree 7^,. 
Without loss of generality we can suppose that 7^ has the property that in it all nodes that 
can be split are split, if necessary by doing additional splittings of any advanced nodes that 
were missed, using transfinite induction. By Konig's infinity lemma there is an infinite directed 
path in 7^ starting from the root. Along that path there is some residue class m' € [3 fc ] that 
occurs as a label infinitely often. Let 4>™ (x + Pj) be the successive labels of the p-nodes on 
this path having residue class m! (mod 3 fc ), starting from the root. We must have each (3j > 
(or the process halts) and also 

ft > ft > ft > ■ • ■ , (3.2) 

because the deletion rule would have removed the p-node labelled 4>™' {x + Pj) if ft > Pi for 
some j > i. 

The tree %o has a recursive self-similar structure, using the fact that all nodes that could 
be split were split. Consider the subtree 7^ [7] grown starting from the root node <fi£ (y + ft) 
along this chain, using the variable Uj = y + Pj- These subtrees are all identical, and / 7J X) [2] 
is obtained from 7^o[l] by shifting the argument of y by 5 = ft — ft > 0. The isomorphism 
of 7^o[2] and %o[l] identifies Tx, [j] with Txjj — 1], and therefore, by induction on j > 2, we 
obtain Pj — ft_i = 5. Thus Pj = Pi + (j — 1)6 for all j > 2, hence ft < for sufficiently large 
j, which contradicts all Pj > 0. 

The back-substitution process halts at a unique tree, regardless of the order leaf nodes are 
split, because the back-substitution process on a given leaf node v does not depend on any 
other leaf nodes, but only on the path from the root node to v. One grows out all leaf nodes 
until they halt, and the total number of steps / until halting is independent of the order of 
growth. ■ 

Theorem 3.2. Let X^(EV) denote the difference inequality system consisting of the inequal- 
ities (Dl), (D2) of 2k plus the complete set of inequalities {^(EL) : m G [3 fc ], m = 8 
(mod 9)}. If §k = {'PTiy) '■ m e [3 fc ]} i s an V se ^ of functions in which each <^™(y) is strictly 
positive and nondecreasing on M>o and satisfies the inequality system Ik for all y > 2, then 
also satisfies the inequalities Ik(EL) for all y > 2. 

Proof. It suffices to show that if the set $fc : = {^(y) : m £ [3 fc ]} of positive nondecreasing 
functions on R + = {y > 0} satisfies Ik for all y > 2, then they satisfy each inequality 1^(1) 
for each I > 1, for all y > 2. 

We prove, by induction on I > 1, that the set $fc satisfies T k m (l). The base case I = 1 holds 
because T k m (l) has only one internal p-node, its root node, and the corresponding inequality 
7™(1) is a member of Ik- Now suppose the induction hypothesis holds for T k m (l), and consider 
T k m (l + 1). To obtain T k m {l + 1) we first split a leaf of T k m (l) to obtain a tree f k m {l + 1) and 
then, if a new m-node was added, we apply the deletion rule to the three vertices of that 
m-node. The splitting procedure yielding T k m (l + 1) substitutes an inequality of Ik, hence $fc 
automatically satisfies T k m {l + 1). 
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Consider the deletion step, applied to the three leaf-node labels of T™(1 + 1) inside the 
min-term 

f(y) :=min[C'(y + /5 , ),C"(y + /3')^ m "'(y + /5 / )] , (3-3) 

in which m! = m" = m'" (mod 3 fc_1 ). The leaf node (f>™ (y + f3') is to be deleted if earlier in 
its directed path from the root appears a p-node with label </>j™ (y + (3") with (3 < (3'. 

To justify the deletion rule, note that the inequality associated to each tree T™(1) for fixed 
functions and a fixed value y > 2, can be written as a sum of terms corresponding to a 
subset of leaves of the tree which are specified by choosing one of the terms in each min-term 
that attains the minimum. (This choice is usually unique once the functions and the value 
y are specified, unless two terms in a min-term have equal values.) We call this set of leaves a 
critical assignment, the leaves in it critical leaves, and the set of paths to these leaves critical 
paths. 

Claim. To each internal p-vertex v of the tree with label 4>™ (y + j3"), and for each fixed value 
°f V > 2, one of two possibilities occurs. 

(a) There are no critical assignments A having a critical path passing through v. 

(b) There is at least one critical assignment A with a path passing through v. For any such 
assignment 

C"(y + /?")> E C (w) (^ + /5(w)) , (3.4) 

where A v denotes the set of critical leaves in A whose paths pass through v. 

Warning: which case (a) or (b) occurs depends on the value of y. The key content of the 
claim is the property (|3.4|) enforced in case (b). 

We will prove the claim by induction on I, and justify the deletion rule at the same time. 
Now ( |3.4[ ) holds for the base case I = 1 where the only internal p-node is the root node, 
and ( |3.4| ) is then an inequality in T^. We assume it holds for T™(1) and wish to prove it for 
T^{1 + 1). First of all, the relations (a), (b) hold for all T fc n (Z + 1). They hold for internal 

p-nodes inherited from T^ m \l), because we have back-substituted If. on the right side of (^j). 
We have added one new internal node v', the one that was split, and for it condition ( [3.4D in 
(b) directly expresses the inequality substituted. 

We call a vertex v of T™{1 + 1) totally non-critical if no critical path passes through it, for 
any critical assignment A, for any y > 2; that is, case (a) holds for v for all y > 2. We can 
safely delete all totally non-critical vertices in T™{1 + 1), and property (b) will still hold for 
the resulting tree T . (The property that a vertex in a tree is totally non-critical is hereditary 
in the sense that all vertices below a totally non-critical vertex are also totally non-critical.) 

We now show that, for those sets of functions that are positive and monotone, all vertices 
removed by the deletion rule are totally non-critical. Suppose the deletion rule appears to the 
leaf vertex w with label <f?u {x + (3') of T™(1 + 1), and let v be a vertex on its directed path 
that has label <F£ {y + 0") with 0" < (3'. If w is not totally non-critical, there is some y > 2 
and a critical assignment A containing w as a critical vertex. Formula ( |3.4| ) of (b) applies to 
gives <t>f(y + (3") > £ ( ™ J)eA , c/>f(y + 0). We deduce 

C'(y + /n>C'(y + /n , (3.5) 
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because (y + j3') is the contribution of w € A v . There is at least one more critical path in 
the sum A v which passes through the p- vertex v' that was split, whose label is c/>™ (y + /?'), 
to its direct p-node descendant (y + j3' — 2). Now /3 > since the node v' is split, hence 
y + — 2 > 0, so 0| m (y + j3' — 2) > by positivity and monotonicity of We conclude 
that (|3.5|) can be replaced by strict inequality 

C(y + /3")>C'(y + /3') • (3.6) 

Since (3" < /3', this violates monotonicity of the desired contradiction. 

Thus, the vertices removed by the deletion rule are totally non-critical, hence for the 
resulting tree T™(1 + 1), the criteria (a), (b) and ( |3.4j ) hold for all p-vertices, for the functions 

for all y > 2. This completes the claim's induction step, and proves the claim. 



Now we may apply (3.4) to the root vertex v for all critical assignments A for all y > 2 is 
equivalent to saying that the satisfy the inequality + 1) associated to T™{1 + 1) for all 
y > 2. This completes the main induction step. ■ 



Remark. The inequality system X\~{EV) involves nested minimization to a depth d(k) which 
grows exponentially with k. The exponential growth occurs because the deletion rule requires 
labels 4% (y + fa), <j>™ (y + fy) with m' = m" (mod 3 fc ) and these are typically separated 
by distance comparable to 3 k . We present statistics in Table [l] on the size of this inequality 
system Zk{EL) for 2 < k < 5, computed by D. Applegate. We measure the size in two ways: 
the depth of nested minimizations, and the total of the number of terms that appear in such an 
inequality. The data is for the term <t>T(y) that had the largest expansion under the elimination 
procedure. 



k 


depth 


# (literals) 


2 


3 


8 


3 


10 


84 


4 


41 


12829 


5 


> 226 


> 10 9 



Table 1: Statistics onTfc(SL) Inequalities 



4. Linear Programs 

We associate to a general difference inequality system T>k (of a sort described below) a family of 
linear program L^(A), as follows. We suppose that consists of inequalities {D™ : [m] € 3 fc } 
in which each inequality is described by a rooted labelled tree 7^ m of the type considered 
in §3, involving variables {c^ : [m] G 3 fc }. The linear program has the basic form: 

Lf(X) : Minimize C max (4.1) 

subject to, for all m £ [3 fc ], 

1 < cf < Cj? ax , 
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together with all inequalities associated to each tree T™ as specified below. 

The LP-inequality system associated to a given tree T involves the principal variables {c™ : 
m € [3 fe ]} and certain auxiliary variables {a v : v an m- vertex of T} . These auxiliary variables 
are distinct for different trees 7j£" '. We associate to each node w the label (m(w), /3(w)) which 
consists of a residue class m(w) and a weight /3(w). For a p-node w these labels are determined 
by its associated function </>™^(x + /?(w)) with to(w) determined (mod 3 fc ). For an m-node 
it is taken from the node function of any of its children, where we view m(w) (mod 3 k ~ 1 ) 
in this case, noting that /3(w)(mod 3 fc_1 ) is the same for all the child nodes. To specify the 
inequalities, we subdivide the tree T into levels: we say that a vertex w is at m-depth d if 
there are exactly d—1 internal m-nodes on the path from the root node to w (not counting w 
itself). The LP inequalities associated to T are in one-one correspondence with the leaf nodes 
of T. To each leaf node w we assign a rooted subtree T w which consists of: 

(1) The terminal part of the path from the root node to the leaf node. If an m-node occurs 
on the path, then it consists of that part of the path from the final m-node to the leaf; if no 
m-node occurs then it is the entire path from the root. We denote this path and call its 
top node the w-root node. Every vertex on V w is a p-node except possibly the w-root node. 

(2) All other children of any p-node on the path V^. These other children are all m-nodes. 
A typical subtree T w is pictured in Figure 2. 




w 



Figure 2: Subtree T w of the leaf node w (m-nodes are circled) 

All the edges of T are partitioned among the V w and each V w contains exactly one leaf 
node. The trees in this partition are also in one-one correspondence with: either the root node 
v or a pair (v, v') consisting of an m-node v and one of its children v'. 
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The LP-inequality associated to the unique leaf node w having no m-nodes on its path is 
of the form 



< \^cZ M + A/?(V)fl v ( 4 - 2 ) 

vGT w 

m-node 



where m = m(vo) for the root vertex vo- For all leaf nodes w such that T w has a node vo as 
w-root node, the associated LP-inequality is 

A^ V °W < X^cf w) + A/3(v) «v- (4.3) 

m-node 

v#v 



Note that the direction of this LP-inequality ( |4.2[ ) for the root node is opposite to that of the 
0™ (y )-inequality. 

For the original difference inequality system 1^, the linear program L k (X) produced in this 
way is equivalent to L k T (X) in the following sense: to every feasible solution of L k T (X) with 
principal variables {c™} there corresponds a feasible solution to L^(X) with the same principal 
variables, and vice-versa. To see this, we note that L k T (X) has auxiliary variables c^_ 1; while 
L^(A) has auxiliary variables a v in one-one correspondence with cV} for m = 2 or 8 (mod 9); 
the LP-inequalities in L k (A) on these variables are equivalent to 



a v < c fc _\ or a v < c k ^ , (4.4) 
e 8 ( mod 9), respectiv< 

The correspondence between feasible solutions of L k T (X) and L k (X) is obtained by setting 



according asm = 2 ( mod 9) or m = 8 ( mod 9), respectively, where c l k n _ 1 ■= m ^ n o<j<2{c^ + ^ 3 }■ 



^ fc _i or a v = c k _\ , (4.5) 



according as m = 2 (mod 9) or m = 8 (mod 9), respectively. 

We let L k L (X) denote the family of linear programs associated to the derived inequality 



system 2™ (EL) of Theorem 3J2 



Theorem 4.1. Suppose for a given X with 1 < A < 2 that the linear program L k T (X) has a 
feasible solution with principal variables {c™ : m 6 [3 fc ]}. Then the linear program L k L (X) has 
a positive feasible solution with the same principal variables. 

Proof. We prove this by starting with the inequality system T>\ := X\. and then successively 
producing inequality systems {T>j : 1 < j < r}, in which "Dj+i is obtained from T>j by a 
single back-substitution in one inequality, and ending at the final system T> r = Ik{EL). For 
definiteness we choose to do the back-substitution procedure on each inequality I™, for m € 
[3 fc ]} in order until it halts, as guaranteed by Theorem |3.1| , and go to the next m, in the order 
m = 2,5,8, ... ,3* - 1. 

We prove by induction on j > 1 that if {c™ : m £ [3 fc ]} yields a feasible solution of L k T (X), 

then these same principal variable values occur in some positive feasible solution of L k 3 (X). 
The base case j ' = 1 holds because the linear program L^(X) agrees with L k T (X); when we 
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assign the auxiliary variables a v the values fl4.5|) we obtain a positive feasible solution with the 
given {c™}. 

For the induction step, first note that in going from Dj to "Dj+i, we "split" one leaf vertex w 
of a particular tree T k m (l), leaving all other trees alone, and then perform a deletion operation. 
The vertex w being a p-node, has associated value m(v) (mod 3 k ). We let T>j+i denote the 
inequalities resulting from the splitting operation before the deletion step. It suffices to show 

that L k J+1 has a feasible solution with the same principal variables, for the deletion step merely 
deletes linear programming inequalities, which preserves feasible solutions. The splitting step 

T> 

changes exactly one of the inequalities in L k 3 ; if it adds a new m- vertex v, then it adds on up 
to three new inequalities, each involving the new auxiliary variable a v for the added m- vertex. 
The corresponding tree is updated to T k m {l + 1). 

Let m! = m(w). If m! = 5 (mod 9), the unique LP-inequality containing the term 
cV? A^( w ) corresponding to w on its right side, has this term replaced by that of a new leaf 
vertex w' with m(w') = 4m', /3(w') = /3(w) — 2 and w' has the same depth no w; its new term 
is c k m A' 3 '™) -2 . However by hypothesis {c™} satisfies L k T (X), hence it satisfies the inequality 

cf < 4 m '\~ 2 . 

Thus we obtain cf A^ w ) < c£ m 'A^ w ~ 2 , so the right side of the new inequality (g]|) or (JO}) 
is less binding than before, and the solution remains feasible. If ml = 2 (mod 9), the term 
c m ^/3(w) ^ g re pi aceo ; w ith 

c 4 m ' A/3 (w)-2 +avA/ 3(w) 

where /3(v) = /3(w) + a — 2, and L k J+1 has three new inequalities 

avA^ < C ™M+J 3fc - V(v) (4.6) 
for < j < 2, with m(v) = 4m (^)~ 2 _ We may choose 

a v = c™W : = minlcf^' 3 " 1 } (4.7) 
and satisfy (O); the fact that {c™} satisfies L k T (X) gives 



c m' A /3(w) < c 4m' A /3(w)-2 + c ^ A /3(w)+a 2 = c 4m' A /3(w)-2 _ ^(v) 

Thus the right side of the equation is less binding than before, so remains feasible. The case 
m' = 8 (mod 9) is handled by similar reasoning to the case m' = 2 (mod 9), so feasibility is 
maintained in this case. The induction step follows. 

The final case of the induction step gives the inequality system X^(EL\ and the theorem 
follows. ■ 



5. Lower Bounds For Difference Inequalities 

We obtain exponential lower bounds for systems of positive nondecreasing functions <3?fc satis- 
fying difference inequalities T> without advanced variables, using an associated linear program 
. The following result is similar in spirit to |2|, Theorem 2.1]. 
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Theorem 5.1. Let := {(/)™{y) '■ m G [3 fc ]} be a set of positive nondecreasing functions on 
M + = {y : y > 0}. Suppose that satisfies a system T> of difference inequalities specified by 
a set of rooted labelled trees {T™ ■ m G [3 fc ]}, such that all inequalities contain no advanced 
variables on their right side. If the associated linear program (A) for A > 1 has a positive 
feasible solution with principal variables {c™} then, for all m G [3 k ], 



im I 



\y) > Acf\y , for all y>0, (5.1) 
with 

A:=A«, (5.2) 
maxjq } 

and v is the largest backward time-shift of a variable in V. 

Proof. Suppose that the set of functions satisfies the system T> := {D™ : m € [3 fc ]} of 
difference inequalities. Set 

IX := min{/? : <fi™ (y — j3) appears on right side of some D™} 

and 

v := max{/3 : 4>™ (y — (5) appears on right side of some D™} . 

The hypothesis of no advanced variables in T> means that \i > 0. Now the inequalities ( |5.1| ) 
hold for all m E [3 fc ], on the initial interval [0, u], since the definition of A gives 

C(2/) > C(0) > AmaxfcHA^ > Ac£^ for y G [0, v], (5.3) 

using the monotonicity and inequality properties of (f>T(y)- 

We now prove that (5.1) holds for all m G [3 fc ] on the interval y G [0, v + jfi] by induction 
on j > 0. It holds for the base case j = by (|5.3|). 

For the induction step, suppose that ( |5.1[) holds for j and we are to prove it for j + 1. It 
suffices to consider a given y G [v+jfi, i/+{j + l)fx]. The induction step consists, schematically, 
of showing 



(y) > Yl nested-min[C'(y + P')} (5-4) 

D™(EL) 

> nested-min[c™ A^'] (5.5) 

> Ac^A^ . (5.6) 



Here (5.4) represents schematically the inequality D™(EL), with the right side actually being 
a nested series of minimizations. Each function <j>™ (y + /?') that appears on the right side of 
( |Q| ) has — v <0< —fx, hence 

< jfi < y + < v + jfi, 
so the induction hypothesis applies to each such term. 
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The induction hypothesis gives 



Substituting thes inequalities in (|5.4j) term by term yields the right side of (|5.5|) , because the 



nested minimization on the right side of (5.4) involves only the operations of addition and 



minimization and these operations are both monotone in each variable appearing in them; also 
the structure T™(EL) in ( |5T5| ) is the tree structure of the inequality D k n (EL). Now let f(y) 
represent the value of the right side of ( [5.5D as a function of y. Each minimization on the 
right side of (|5,5| ) corresponds to a m-vertex v of T k m (EL); we let f v (y) equal the value of this 
minimization expression as a function of y. Next we can apply the inequalities in L^ L {\) in a 
suitable order to prove that 

f v (y) > AA> V A« V >). 

for all m-vertices; the order starts with the innermost minimization and works outward. At 
the last step we reach the root vertex and obtain 



since (3 (wo) = 0. This gives the right side of (5.6). Since this holds for all k £ [3 m ], this 
completes the induction step. ■ 

We now prove the main Theorem |2.2| by combining the results of §3 §5. 



Proof of Theorem ^2. Theorem ^2 shows that any set of positive nondecreasing functions 
that satisfies the inequality system also satisfies the derived inequality system Zk{EL) 
which has inequalities with no advanced variables on their right sides. The family of linear 
programs associated to this inequality system in §4 is denoted Lf L {\). 

Suppose now that for a given A > 1 the inequality system L^ T (X) has a feasible solution 
with principal variables {c™ : m € [3 fc ]}. Theorem ^[l] established that the linear program 
L? (A) has a positive feasible solution with the same principal variables and the same value 
of A. 



Theorem 5.1 then applies to the system Ik{EL) to show that any positive feasible solution 



of L^ L (X) yields the bounds, for all m € [3 A 

C(y) > &c k m \y for all y > 0, (5.7) 

with 

4:=r=» (5.8) 
max{q ; } 

where v is the largest backwards timeshift. 

For the system <3?fc = {<j)™(y) : m £ [3 fc ]} coming from the 3x + 1 problem, we have by (PI) 
that </>™(0) > 1. We also have A < 2 and the maximum retarded term v < 2. Thus we have 

A > Ai 



4 max {c™} 

which, with fl5.7|), implies the desired bound ( 2.16j ). ■ 
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Remark. Theorem 2.2 has the counterintuitive feature that iterating the inequalities seems 
potentially to strengthen, rather than weaken, the exponential lower bound obtained. It allows 
the possibility that the linear program L^ L (X) has a positive feasible solutions for a larger value 
of A than is obtainable using the original linear program family L^ T (X). However we believe 
this cannot occur, and that the exponent obtained from L^ T (\) is the largest possible for 
positive monotone solutions to the original difference inequalities Z^. This is discussed at the 
end of §6. 



6. 3X + 1 Lower Bounds 

We obtain lower bounds for the number ir\{x) of integers below x that eventually iterate to 1 
under the 3x + 1 function. 

Theorem 6.1. For each positive a ^ 0(mod 3) the function 

iT a (x) := [{1 < n < x : Some T^(n) = a.}\ 
satisfies, for all sufficiently large x > xo(a), 

Proof. This follows from Theorem |2.2| , by finding a positive feasible solution by computer 
to the linear program family L% T (\) for k = 11, for A = 1.7922310, see Table 2 below. This 
yields the exponent 7 = log 2 A « 0.84175. ■. 



Table 2 gives data on the bounds for the optimal A for L^ T for 2 < k < 11. 



For 1 < k < 9 



these are taken from ||]; the new values for k = 10, 11 were computed by D. Applegate. 



k 


Ik 




(jmax 


Ck,k 


c k-l,k 


Ck,k — Ck-l,k 


2 


0.4365880 


1.3534010 


1.8316920 


1.5237640 


1.0000000 


0.5237640 


3 


0.6112620 


1.5275960 


3.4881908 


2.1014900 


1.6994294 


0.4020606 


4 


0.6891080 


1.6122870 


5.4951954 


2.7869040 


2.4010985 


0.3858055 


5 


0.7335790 


1.6627590 


9.0756176 


3.4648343 


3.0771822 


0.3876521 


6 


0.7608180 


1.6944520 


12.8769418 


3.9667005 


3.5825321 


0.3841684 


7 


0.7825670 


1.7201900 


20.1963763 


4.8122983 


4.4061650 


0.4061333 


8 


0.8031960 


1.7449630 


29.1315157 


5.2028179 


4.8181536 


0.3846643 


9 


0.8168300 


1.7615320 


43.3394210 


5.8102043 


5.4164870 


0.3937173 


10 


0.8295450 


1.7771270 


64.9801068 


6.4567870 


6.0648572 


0.3919298 


11 


0.8417560 


1.7922310 


98.4009647 


7.1552344 


6.7695583 


0.3856761 



Table 2: NLP Lower Bounds: No truncation of advanced terms 



The last three columns in Table || give some average quantities formulated in 

1 ^ ™ 



Define 



Ck,k ■'- 



3&-1 

m£[3 k ] 



c k 
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and ^ 

Ck-i,k ■= C ™-1- 

m€[3 k - 1 ] 

Adding up all the inequalities in L^ T (X) leads to 

Ck,k < A 2 Ck,k + 1 + A a ~ 2 )cfc-l,fc. 

In Q it was noted that a necessary and sufficient condition for a bound like vri(x) > x 1 ~ e to 
hold for each e > and all sufficiently large x is that Afc^2as£;— >oo, and this in turn would 
follow from the existence of feasible solutions with 

Ck-l,k . , 

> 1 as k — > oo. 

Ck,k 

Table [2] gives more empirical data on these quantities. 

The supremum of the exponential lower bounds that can be extracted from the linear 
program family L^ T (X) is given by A^, the supremum of values of A for which L^ T (X) has a 
feasible solution. These values satisfy A& < Xk+i, because given a feasible solution to Lk(X) 
with principal variables dP one can define 

C + i r3fe ■= € for < j < 2, 

and obtain a feasible solution to Lj^j^A). It remains an open problem to show that the values 
Afc are strictly increasing in k. As already noted in [||, showing that A& — > 2 as k — > oo would 
imply a lower bound ir a (x) > x l ~~ e holds for each positive e, for each a ^ (mod 3) and all 
sufficiently large x > xo(a). 

We now relate the linear program system L^ T (X) used here to the linear program system 
denoted L^ T in These two linear program systems are equivalent in the sense of Theo- 
rem 2.2; namely, the set of A for which they have a strictly positive feasible solution coincide. 



To see this, observe first that if L^ T (X) has a feasible solution, then it has a strictly positive 
feasible solution. One may have to modify the auxiliary variables, which might be negative, 
while holding the principal variables fixed. However the auxiliary variables can be forced to 
their maximal values in terms of the principal variables without affecting feasiblity. Such a 
feasible solution has all values at least 1, so strict positivity is attained, and this solution also 
satisfies L^ T . Conversely, given a positive feasible solution to L^ T , it can be multiplicatively 
rescaled to have objective function value cf = 1, and this gives a feasible solution to L^ T (X), 
on taking C™ ax := max {c™}. 

We conclude the paper by discussing the possibility that the lower bound obtained in 



Theorem 2.2 give the largest that is implied by the difference inequalities Ik- This would 
follow if one could exhibit a positive monotone solution to 1^ that has a growth rate matching 
the lower bound. Such a pure exponential lower bound could potentially be constructed from 
a solution to L^ T (Xk)- Two conditions must hold: 

(1) The supremum Xk is attained. That is, L^ T (Xk) has a feasible solution. 

(2) At the supremum value A& , there exists a feasible solution in which all of the principal 
inequalities (L1)-(L3) hold with equality. 
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If conditions (1), (2) hold, then the functions (f>T{y) = c ™^| would satisfy with equality 
for all times y > 2, and would constitute a positive monotone solution to attaining the best 
lower bound given by Theorem |2.2| . Experimentally this is the case for k < 11. 

Regarding condition (1), L^ T (Xk) could fail to have a feasible solution at the supremum 
value Afc only if the objective function value as A — > Xk from below diverges to do, so some 
variables c™ become unbounded. Regarding condition (2), the complementary slackness con- 
ditions for an optimal solution would for a generic linear program of this type force all the 
principal inequalities (L1)-(L3) to hold with equality. This would happen, for example, if there 
were an optimal solution at which all variables c™ took distinct values. We think it likely that 
properties (1), (2) hold for all k > 2, but this may be difficult to prove. 

The supremum linear program L^ T (Xk) has a finite optimal objective function value C™ ax 
provided that condition (1) holds, as we now assume: denote this value by C™ ax . The value 
(jmax Y^Qg an interesting meaning: it measures the minimal spread attainable in the values 
of c™, while normalizing these variables by min{c™} = 1. This quantity shows up in the 
constant Ai in Theorem 2.2. One may view the value C™ ax as a quantitative measure of a 
rate of "mixing" between congruence classes (mod 3 fc ) that the 3x + l function produces. The 
fourth column of Table 2 indicates that the quantity C™ ax exists for k < 11, and it appears to 
grow exponentially with k. 

Acknowledgments. The authors thank David Applegate for computations given in Tables 
1 and 2. 



Appendix: Inequalities for k = 2 

The case k = 2 is the only case where the derived inequalities Ik(EM) and the linear program 
family L^ M (X) can be easily written down. There are three functions <J>2 := {4>2(y)i ^2(2/)) 02 (2/) • 
y > 0} . Recall that a = log 2 3 rs 1.585. The inequalities I2 are 

4(V) > 4{V - 2) + min[0|( 2 / + a - 2), <j%(y + a- 2), 4{y + a- 2)], 

4(y) > 0K2/ -2), 

4>l{y) > ^i(y-2)+xnin[^(y + o-l),^(y + a-l) J ^(y + a-l)]. 
Of these, only the inequality for 4^{y) contains advanced terms on its right side. 

The corresponding inequality Z^EL) has three leaves of nested minimization. The cor- 
responding tree T^EL) is pictured in Figure 3, with the deleted nodes indicated. The tree 
T^EL) has three m-nodes and eight leaf nodes. We let a\, ci2, 0,3 be the auxiliary variables 
for the leaf nodes, numbered as in Figure 3, and its associated inequalities are: 

4(y) > 4(y " 2) + mh#|(y + a - 3) + M^y), <j> 2 2 {y + a- 3)] , 

in which 

Mi(y) := mm[0|(y + 2a - 5) + M 2 (y), 4(y + 2a- 5)] , 

and 

M 2 (y) := min[02( y + 3a - 5), 0|(y + 3a - 5), <^(y + 3a - 5)] . 
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The inequalities in the linear program L|' L (A) for the three trees T™(EU) with m = 2,5 
and 8 are given in Table ||; they are associated to the leaves of these trees, identified by their 
labels in Table 
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Tree 


Leaf node label 


Inequality 




/o 

(8, 


-2) 


4 < 4\~ 2 + a\\ a - 2 


T 2 (EL) 


(2, 


a - 2) 


a^ 2 < c 2 X a ~ 2 




(5, 


a - 2) 


a[X a ' 2 < c\\ a ~ 2 




(8, 


a - 2) 


d x X a ' 2 < c%\ a ~ 2 


7* (EL) 


(2, 


-2) 


^ 2 \ —2 

c 2 < c 2 A 




(5, 


-2) 


4 < 4\~ 2 + a l \ a - 1 




(8, 


a — 3) 


aiA"- 1 < c^A"- 3 + a 2 A 2a " 3 




(2, 


a — 3) 


aiA"- 1 < 4\ a - 3 


Ti(EL) 


(8, 


2a - 5) 


a 2 A 2A " 3 < 4\ 2a ~ 5 + a 3 A 3a " 5 




(2, 


2a -5) 


a 2 X 2a - 3 < 4\ 2a ~ 5 




(2, 


3a — 5) 


a 3 X 3a ~ 5 < 4\ 3a ~ 5 




(5, 


3a -5) 


a 3 X 3a - 5 < 4X 3a ~ 5 




(8, 


3a — 5) 


a 3 X 3a ~ 5 < 4X 3a ' 5 



Table 3: Lf L (A) inequalities for trees T^(EL). 
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